Uncertainty Analysis of Air Radiation 
for Lunar Return Shock Layers 

Bil Kleb* and Christopher 0. Johnston^ 


By leveraging a new uncertainty markup technique, two risk analysis methods are used 
to compute the uncertainty of lunar-return shock layer radiation predicted by the High- 
temperature Aerothermodynamic Radiation Algorithm (HARA). The effects of epistemic 
uncertainty, or uncertainty due to a lack of knowledge, is considered for the following mod- 
eling parameters: atomic line oscillator strengths, atomic line Stark broadening widths, 
atomic photoionization cross sections, negative ion photodetachment cross sections, molec- 
ular bands oscillator strengths, and electron impact excitation rates. 

First, a simplified shock layer problem consisting of two constant-property equilibrium 
layers is considered. The results of this simplified problem show that the atomic nitro- 
gen oscillator strengths and Stark broadening widths in both the vacuum ultraviolet and 
infrared spectral regions, along with the negative ion continuum, are the dominant un- 
certainty contributors. Next, three variable property stagnation-line shock layer cases are 
analyzed: a typical lunar return case and two Fire II cases. For the near-equilibrium lunar 
return and Fire 1643-second cases, the resulting uncertainties are very similar to the sim- 
plified case. Conversely, the relatively nonequilibrium 1636-second case shows significantly 
larger influence from electron impact excitation rates of both atoms and molecules. For all 
cases, the total uncertainty in radiative heat flux to the wall due to epistemic uncertainty in 
modeling parameters is ±30% as opposed to the erroneously-small uncertainty levels (±6%) 
found when treating model parameter uncertainties as aleatory (due to chance) instead of 
epistemic (due to lack of knowledge) . 

I. Nomenclature 

AAg ? o Stark broadening width at 10,000 K and 10 16 cm -3 electron number density 

A cl, mult Atomic multiplet centerline wavelength (nm) 

v Photon frequency (eV) 

a Statistical standard deviation 

a~ Negative ion continuum cross section 

a\)f Photoionization cross section 

Cauchy-distributed value of i-th parameter, k-th sample 
e Scaled difference for k - th sample 
/ Generic function 

fij Oscillator strength 

h Planck constant 

I Radiation intensity (W/cm 2 / sr) 

K e i Electron-impact excitation rate 

q r Radiative heat flux directed toward the wall (W/cm 2 ) 

ri Uniformly-distributed random number on (0, 1) for i-th parameter 

Si Sensitivity derivative of input parameter i 

xi Input parameter i 

y Generic output value 


* Aerospace Engineer, Aerothermodynamics Branch, Research Technology Directorate, lifetime AIAA member, 
t Aerospace Engineer, Aerothermodynamics Branch, Research Technology Directorate, AIAA member. 
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II. Introduction 


The design of the thermal protection system (TPS) for NASA’s lunar return capable Orion vehicle (also 
referred to as CEV) requires the accurate prediction of the shock layer radiative heating. Preliminary 
studies have shown that the radiative heating rate may be equal to or greater than the convective heating 
rate at peak heating conditions. 1 The High-temperature Air Radiation Algorithm (Hara) was recently 
developed at NASA Langley Research Center to provide these radiative heating predictions. The results of 
this code have been compared with the Fire II and Apollo 4 flight data, 2,3 as well as the recent Electric- Arc 
Shock Tube (EAST) measurements. 4,5 These comparisons have indicated a reasonable agreement between 
measurements and Hara predictions for the wavelength ranges measured, which were limited to wavelengths 
above 200 nm. The lack of data below 200 nm (the vacuum ultraviolet (VUV)) prevents the the validation 
of radiation models, such as the Hara code, in this wavelength range. This lack of experimental validation 
must be addressed since the VUV may contribute up to half of the total radiative flux for Orion. 1 An 
alternative to validating Hara with experimental data is to examine the accuracy (or uncertainty) of the 
physical parameters applied by Hara (which themselves are obtained from experiments) and determine their 
influence on the predicted radiative flux. The absence of VUV experimental data motivates this uncertainty 
analysis approach, which will also be valuable for rationalizing the minor disagreements between Hara and 
the non- VUV measurements cited previously as well as for quantifying the total radiative heating prediction 
uncertainty for Orion TPS design. 

The following three sections describe the radiation modeling, the uncertainties considered, and the un- 
certainty analysis techniques. These sections are followed by results for a simplified shock layer problem 
problem, which considers the radiation emitted from two constant property layers of equilibrium air. This 
conceptually simple problem is relevant to the mostly equilibrium shock layers present at peak-heating lunar 
return conditions. Following the study of this simplified case are the analyses of three shock layer cases: a 
case representative of an Orion shock layer at peak heating and the Fire II 1636- and 1643-second trajectory 
point cases. 


III. Radiation Modeling 

The Hara radiation model applied in the present study is discussed in detail by Johnston 2 * and Johnston 
et al. 6,7 This model is based on a set of atomic levels and lines obtained from the National Institute 
of Standards and Technology (NIST) 8 and Opacity Project databases. 9 The atomic bound-free model is 
composed of cross sections from the Opacity project’s online TOPbase, 10 which were curve fit to a convenient 
form by Johnston. 2 The molecular band systems are treated with the computationally efficient smeared- 
rotational band (SRB) model. 11 This approximate molecular model is accurate for the present lunar return 
applications because the emitting molecular bands are optically-thin. 12 The SRB model has also been 
shown to be sufficient for modeling strongly absorbing VUV band systems. 6 The non-Boltzmann modeling 
of the atomic and molecular electronic states is based on a set of electron-impact excitation rates compiled 
from the literature and presented in detail by Johnston. 2,7 Following the work of Park, 13 the quasi-steady 
state assumption is made when solving the Master Equation for the atomic and molecular electronic state 
populations. 


IV. Radiation Modeling Uncertainties 

The following subsections describe the parameter uncertainties chosen for the present analysis. A total 
of 3627 individual uncertainty values were treated in this work. 

A. Atomic Lines 

The atomic line model applied in Hara is discussed in detail by Johnston et al. 6 A brief review of this 
model, focused on the model uncertainty, is provided here. For the strongest lines of nitrogen and oxygen, 
the available data for oscillator strengths and Stark broadening widths were assessed by Johnston et al. 6 and 
uncertainty values were proposed. These uncertainties, for the oscillator strength (fy) and Stark broadening 
width (AA^o)? are listed in Tables 1 and 2 for the strongest nitrogen and oxygen line multiplets. The choice 
of these uncertainties will be discussed in the following paragraphs. 
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For lines not listed in Tables 1 and 2, the fy uncertainties proposed by Wiese et al. 14 were applied for 
the NIST lines, and an uncertainty of ±30% was assumed for the additional Opacity Project lines. 9 The 
AA^o uncertainties for lines not listed in Tables 1 and 2 were assumed equal to ±50% if the AA^o value was 
taken from Griem 15 or Wilson and Nicolet. 16 Otherwise, the AA^o value was obtained from an approximate 
correlation 6 and the AA^o uncertainty was set to ±100%. 


Table 1: Strongest nitrogen line multiplets. 


multiplet 

number 

Wiese 

ID* 

hv 

(eV) 

A CL, mult 

(nm) 

±/« 

(%) 

±AAs ; o 

(%) 

1 

24 

11.61 

106.80 

75 

75 

2 

23 

11.29 

109.77 

75 

75 

3 

19 

10.62 

116.79 

50 

40 

4 

17 

10.53 

117.69 

50 

40 

5 

39 

10.42 

118.91 

75 

75 

6 

38 

10.41 

119.10 

75 

75 

7 

1 

10.33 

120.00 

20 

50 

8 

37 

10.12 

122.52 

75 

75 

9 

16 

9.972 

124.32 

20 

100 

10 

35 

9.459 

131.07 

60 

30 

11 

32 

9.396 

131.95 

20 

30 

12 

30 

8.781 

141.19 

20 

100 

13 

15 

8.302 

149.33 

10 

30 

14 

29 

7.110 

174.36 

20 

50 

15 

48 

1.663 

745.42 

10 

30 

16 

47 

1.509 

821.41 

10 

30 

17 

52 

1.438 

861.98 

10 

30 

18 

46 

1.426 

869.40 

15 

30 

19 

65 

1.369 

905.24 

25 

30 

20 

127 

1.369 

905.01 

15 

30 

21 

126 

1.347 

919.82 

50 

100 

22 

51 

1.319 

939.79 

25 

50 

23 

72 

1.260 

983.33 

15 

50 

24 

70 

1.241 

998.70 

25 

100 

25 

71 

1.240 

999.10 

75 

100 

26 

69 

1.225 

1011.7 

10 

50 

27 

80 

1.158 

1070.0 

75 

75 

28 

81 

1.177 

1052.6 

10 

75 

29 

68 

1.098 

1128.9 

15 

75 

30 

61 

1.068 

1160.0 

25 

100 

31 

100 

1.029 

1204.4 

10 

100 

32 

99 

0.994 

1246.9 

15 

100 

33 

114 

0.910 

1362.0 

10 

100 


Multiplet number listed by Wiese et al. 14 


Table 2: Strongest oxygen line multiplets. 


multiplet 

number 

Wiese 

ID* 

hv 

(eV) 

L ,mult 

(nm) 

±/i, 

(%) 

iAAS’0 

(%) 

1 

2 

9.51 

130.35 

3 

50 

2 

56 

1.59 

777.55 

3 

50 

3 

60 

1.47 

844.88 

10 

50 

4 

64 

1.34 

926.64 

3 

50 

5 

78 

1.09 

1128.7 

3 

50 
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Figure 1: Predicted and measured nitrogen multiplet oscillator 

strengths, normalized by the Wiese et al. 14 values, for the first 
14 multiplets of Table 1. 



Figure 2: Predicted and measured nitrogen multiplet oscillator 

strengths, normalized by the Wiese et al. 14 values, for multiplets 
15-33 of Table 1. 


□ □ □ □ □ 
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Morris & Garrison (1969) 
Helbig et al. (1976) 
Cullmann & Labuhn (1978) 
Nubbemeyer (1980) 

Goly & Weniger (1986) 
Sohns & Kock (1992) 
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Griem (1974) 
no data 
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Multiplet number listed by Wiese et al. 14 


Figure 3: Comparison of various experimental and theoretical Stark 
broadening coefficients, normalized by the average, for the 33 ni- 
trogen lines listed in Table 1. 
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The theoretical 9, 17 and experimental 18 22 data collected to determine these oscillator strength uncer- 
tainties are presented in Figures 1 and 2 for nitrogen multiplets 1-14 and 15-33, respectively. As discussed 
by Johnston et al., 6 the present uncertainties were chosen based on the deviation of the post-1970 data 
(therefore neglecting the Wiese et al. (1966) data 23 and Wilson and Nicolet (1967) data 16 ) shown in Figures 
4 and 5 from the Wiese et al. (1996) values. 14 However, for the multiplets with only the Wilson and Nicolet 
(1967) 16 and Wiese et al. (1996) values 14 available (multiplets 1, 2, 4 and 5), the difference between these 
two values were used in the uncertainty determination. The presently chosen uncertainties are generally 
higher than those proposed by Wiese et al. (1996), although a few remain the same. A minimum uncertainty 
of ±10% was chosen because no experimental measurement contained an uncertainty lower than this value. 
The uncertainties listed in Table 2 for oxygen lines are taken directly from Wiese et al. (1996). 

The experimental 24 29 and theoretical data collected to determine the AA^o uncertainties are shown in 
Figure 3 for the multiplets listed in Table 1. For the multiplets with only the Wilson and Nicolet values 
available, an uncertainty of ±75% was assigned based on the comparison with other multiplets, while for the 
cases with ”no data”, an uncertainty of ±100% was conservatively chosen. For the multiplets with various 
measurements available it is noted that, except for multiplets 7, 9, 12, and 14, the measurement uncertainties 
overlap the averaged value (meaning they overlap the value of 1 in the figure) as well as the nominal values 
from the other measurements and predictions. Considering this, the uncertainty was chosen to capture the 
nominal values, relative to the average, from all the measurements and theoretical results. 

B. Atomic Photoionization Cross Sections 

Recent theoretical predictions by various researchers of nitrogen 30 32 and oxygen 33,34 photoionization cross 
sections (<Jbf) agree within 10% of each other. However, the comparison of predictions with actual mea- 
surements 35 39 is much worse, with the agreement ranging from 30-50%. A complication in the analyses of 
the measurements is the possible influence of the negative nitrogen ion, which provides an increase in the 
continuum radiation. The uncertain magnitude of the negative nitrogen ion cross section, which will be dis- 
cussed later, makes it difficult to subtract out of the continuum measurement to obtain the photoionization 
contribution. As a tradeoff between the consistency of the theoretical predictions and the poor agreement 
with the measurements, which depends on how the negative ion is treated, an uncertainty of ±20% is chosen 
for all the photoionization cross sections of nitrogen and oxygen. 

C. Negative Ion Continuum Cross Sections 

As a result of the few theoretical predictions available 40-42 and the difficulty mentioned previously in ob- 
taining cross sections from experimental data 43 (due to the overlapping photoionization contribution), there 
is significant uncertainty in the negative ion continuum cross section (a - ). 44 From the wide spread of pro- 
posed cross sections, an uncertainty of ±100% is chosen for the negative nitrogen ion. The nominal a~ values 
applied in Hara are presented by Johnston et al. 6 The lower limit of the ±100% uncertainty represents 
neglecting the negative ion contribution entirely. 

D. Molecular Band Oscillator Strengths 

The most significant emitting molecular band system in air at the present conditions is the first- negative 

system. The oscillator strength uncertainty for this band system is chosen as ±10%, following comparisons 
by Langhoff and Bauschilcher. 45 Following Laux and Kruger, 46 the uncertainties for the N 2 first-positive, 
N 2 second positive, and all NO band systems are chosen as ±10%. For the N 2 VUV bands systems 6 (Birge- 
Hopfield, Worley, Worley- Jenkins, and Carroll-Yoshino), an uncertainty of ±50% is chosen based on the 
comparisons presented by Stark et al., 47 Chan et al., 48 Appleton and Steinberg, 49 and Carter. 50 

E. Electron-Impact Excitation Rates 

For the lunar return conditions of present interest, the electron-impact excitation rates {K e {) are the dominant 
contributors to the non-Boltzmann calculation for both atoms and molecules. The electron-impact excitation 
rates applied in Hara were presented by Johnston et al., 7 who also showed that significant uncertainty exists 
in the chosen values. For example, Figure 4 compares the rates proposed by various researchers 51-54 for an 
atomic nitrogen transition. The range of values shown in this figure indicate that a one order-of-magnitude 
uncertainty is appropriate. Other comparisons presented by Johnston 2 for atomic nitrogen and oxygen show 
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that a one order of magnitude uncertainty is appropriate for all atomic electronic-impact excitation rates. 
This value is applied in the present study. 




Figure 4: Comparison of electron-impact excitation rates proposed Figure 5: Comparison of electron-impact excitation rates proposed 

by various researchers for an atomic nitrogen transition. by various researchers for an AT+ transition. 


A comparison of proposed values 55-57 for the X - B transition, which is the dominant transition for 
populating the upper state of the strongly emitting first-negative band system, is shown in Figure 5. 
Ignoring the result of Gorelov et ah, 55 a plus or minus one order of magnitude uncertainty is seen to bound 
the various values. Johnston 2 shows similar comparisons for other N 2 and rates. Therefore, a one order 
of magnitude uncertainty is applied in the present study to all molecular electronic impact excitation rates. 

V. Uncertainty Analysis Techniques 

Kleb et al. 58 introduced a new method of specifying input uncertainties that could readily be used with 
a wide range of numerical simulation codes and to create a persistent, in situ means to document model 
parameter uncertainties. For example, if an input file included an entry such as parameter = 5.0, it could 
be marked up with a tolerance like parameter = 5.0+/-10°/ 0 to a produce “fuzzy” version of the original 
input file that documented the uncertainty of the input parameters. 

In our previous work, 58 we treated all the tolerances in these “fuzzy” files as variabilities (uncertainties 
with probability distributions) and used the Monte Carlo method to determine the variability in the out- 
put. The output variability we found, however, was unexpectedly small and after further investigation, 60,61 
discovered that we were failing victim to a common mistake in the field of risk analysis: treating epistemic 
uncertainty (uncertainty due to lack of knowledge) as aleatory uncertainty (uncertainty due to chance). 

In saying that we knew even uniform distributions for the input parameters was claiming too much. 
When using any sort of scaled distribution (e.g., normal, triangular, or uniform) for the input parameters, 
the second fundamental theorem of probability, the Central Limit Theorem, 59 holds sway and produces a 
normal output distribution with a variance according to, 

Cout = cr in /VN (1) 

where N is the number of input distributions and <r out and a- in are the standard deviations of the output 
and input distributions, respectively. No matter which input parameter probability distributions we chose 
(e.g., normal, uniform, or triangular), we obtained the same, inexplicably small, output uncertainty. 

To overcome this under estimation of the output uncertainty, we set out to perform second-order probabil- 
ity analysis 60,61 where we would admit that some of our inputs should be treated as epistemic uncertainties 
(unknown within an interval) and not as aleatory uncertainties (variable according to some probability distri- 
bution). As detailed in the preceding section, however, none of the input parameters we are considering have 
enough data to justify assigning a probability distribution, and so all input parameters became intervals, 
devoid of probability distributions. 

A result of not having probability distributions for the parameter uncertainties is that the nominal 
parameter values and the resulting nominal (or mean) value of the function (in this case the radiative flux) 
are no long defined. In other words, the nominal parameters are arbitrary. Hence, they do not represent the 
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most probable value, as they would if, for example, a Gaus- 
sian distribution was assumed. The consequence of an 
arbitrary nominal is indicated in Figure 6, which shows 
the variability around various sets of nominal values ob- 
tained by assuming uniform probability distributions for 
the epistemic input parameters. The thick curve to rep- 
resents the radiative flux predicted by HARA when using 
the nominal parameters chosen in the development of the 
code when some input parameters are specified to have 
aleatory uncertainties (variability due to chance). The 
other curves represent the variability if different nominal 
parameters were chosen within the specified uncertainty 
intervals. These curves are just as relevant as the initial 
nominal because the probability distributions of the inputs 
are uniform. This is known as a second-order probability 
analysis, i.e., treating aleatory and epistemic uncertainties 
separately. It is clear from this figure that the variation of 
the nominal (or mean) is greater than the 2-cr variability of 
any single case. The epistemic uncertainty approaches ap- 
plied in this work compute this variation in the mean, but 
for our case, we have no underlying distributions due to aleatory input uncertainties but single deterministic 
output values due to only having epistemic uncertainties. 

As shown by Kreinovich et ah, 62 only two methods can accommodate epistemic uncertainty. The first 
is direct numerical differentiation and the second is the Monte Carlo-based, Cauchy Deviates Method. 63 
Given sufficiently small differences for the former and a sufficiently large number of samples for the later, 
both techniques will give the same maximum possible output uncertainty due to input parameter uncer- 
tainty intervals. For the present study, the numerical differentiation method required exactly 3627 HARA 
evaluations (which is equal to the number of uncertainty parameters considered) while the Cauchy Deviates 
method required less than 500 HARA evaluations. The relatively small computational time required by the 
HARA code (30 seconds for a shock layer line of sight) made both approaches feasible. Therefore, they were 
both applied to assure proper implementation. The resulting uncertainties were found to agree within 5%. 
The following subsections outline each method. 


variation of 



Figure 6: Example of second-order probability analysis that con- 
tains both aleatory and epistemic uncertainties. 


A. Numerical Differentiation 

Direct numerical differentiation is used to obtain sensitivity derivatives of outputs with respect to inputs. 
Consider an output function, y, that is a function of a set of n input parameters, aq, , x n , 

y = f(xi, !•„). (2) 


By applying the chain rule and linearizing, we can determine the maximum possible uncertainty in y given 
the uncertainty in inputs, 

Ay = |si | • Axi + . . . + |s n | • Ax n (3) 

where s t is the linearized sensitivity derivative of / with respect to Xi, 


Si = 


A / 

A 


(4) 


Here A aq is typically taken as the width of the uncertainty interval provided that the function remains linear 
over that range. 


B. Cauchy Deviates Method 

The Cauchy Deviates Method 63 is a Monte Carlo technique for computing uncertainty when inputs have 
epistemic uncertainty, i.e., only input intervals are known due to lack of knowledge. 
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The basic steps of any Monte Carlo method are as follows: 


1. Define scope of the problem. For the present study this involves the 
simulation, using the Hara code, of the radiative flux emitted from a 
high temperature gas. 

2. Assign uncertainties to model input parameters. The previous section 
lists the uncertainties presently considered for the Hara code. 

3. Randomly sample inputs, run, and repeat until the statistics have 
converged. 

4. Compute input-output correlations, scatter plots, sensitivities, and 
other quantities of interest. 

Each “fuzzy” file is randomly sampled to provide a given realization, the 
underlying code is run, and these steps are repeated until statistical con- 
vergence of the outputs is reached. The overall work flow is depicted in 
Figure 7. 

Specifically, the Cauchy Deviates Method 63 has the following steps: 

1. Compute the nominal case, i.e., y = /(aq, . . . , x n ). 

2. For k = 1,2,..., TV, where N is the number of samples, repeat the 
following: 

(a) Compute Cauchy distributed values, c[ k ^ = tan(7r • (r^ — 0.5)) 

(k) 

where r\ ; is a random number uniformly distributed between 0 
and 1; 

(b) Store the maximum of the absolute values, c$ a x = max |c^|; 

(c) Compute sampled input, x\ k ^ = Xi + A* • c\ k ^ /c$ax\ 

(d) Compute the scaled difference, d ^ = Cmax(f(x^) - y); 

3. Solve A 2 + tJ (1)) 2 H 1- A 2 + ^ 2 (JV ))2 = N/2 by method of bisection on 

the interval [0 ,dmax\- 

A useful property of Cauchy Deviates Method is that it has an estimated 
confidence interval proportional to the number of samples and independent 
of the number of input parameters. So while the work associated with direct 
numerical differentiation scales linearly with number of input parameters un- 
der consideration, the Cauchy Deviates Method scales only with the desired 
level of confidence in the output uncertainty. 


Input files 




A 

f Reduce data 1 


^ ' 


Figure 7: Simulation architecture. 


VI. Results 


A. Dual-Layer Slab Case 

The radiative flux along the stagnation line of a peak heating lunar return 
shock layer may be represented approximately with two constant property 
layers of air in chemical equilibrium. This simplified problem avoids the 
complexity of a variable-property shock layer while maintaining the funda- 
mental characteristics (significant to radiation) of peak heating lunar return 
shock layer. The case studied here is shown in Figure 8. The first layer 
(Layer 1), which has a thickness of 15 cm and a temperature of 10,000 K, 
represents the inviscid region of the shock-layer, while the boundary layer is 
represented by the 1 cm layer at 5,000 K (Layer 2). A pressure of 0.5 atm 


Layer 1 I Layer 2 

I 


h 

10,000 K ! 5,000 k; 

0.5 atm J 0.5 atm 

15 cm II cm 

i 

shock wall 

Figure 8: Dual-layer slab configuration. 
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is assigned to both layers. The radiative flux resulting from both layers and directed towards the wall, as 
shown in Figure 8, is defined as q r and will be the subject of the present study. 

The radiative flux spectrum and resulting cumulative flux are shown in Figure 9 for Layers 1 and 2. As 
expected, the absorption from Layer 2 is located entirely above 6 eV (VUV) and reduces the total flux from 
380 to 323 W/cm 2 . The absorption seen between 12 and 14 eV is due mostly to the TV 2 Birge-Hopfield 
band systems, while that between 14 and 16 eV is from the TV and O bound-free continuum. The emission 
contributions of each radiative mechanism is indicated in Figure 10, which shows the radiative flux from 
Layer 1 assuming emission from only the specified mechanism, but absorption from all mechanisms. The 
strong contribution from atomic nitrogen atomic lines is noted followed by the atomic nitrogen bound-free 
continuum. 



Figure 9: Spectrum and cumulative flux at the edge of Layers 1 
and 2. 



8 10 
hv (eV) 


Figure 10: Spectrum and radiative flux components from Layer 1. 


Applying to this case the previously described uncertainty approach along with the previously chosen 
parameter uncertainty intervals, radiative flux uncertainty values of ±93.1 W/cm 2 (25%) and ±93.9 W/cm 2 
(29%) were calculated for Layers 1 and 2, respectively. For both cases, the uncertainty below 6 eV (non- 
VUV) was found to be ±66.4 W/cm 2 (28%). Meanwhile, treating the input uncertainties as aleatory (known 
variability due to stochastic process) yields only ±7%. 

The contributions of the various parameter groups to these uncertainties are listed in Tables 3 and 4 
in order of largest to smallest contribution. For both layers the top three parameters are the atomic ni- 
trogen oscillator strengths ( fij (TV)), atomic nitrogen Stark broadening widths (AA^o (TV)), negative ion 
cross-section (cr _ ), and atomic nitrogen bound-free cross-sections (TV)). The molecular band oscillator 
strength contribution is larger for Layer 2 because the Birge-Hopfield band system contributes significantly to 
the vacuum ultraviolet absorption present in Layer 2. This is indicated in Table 5, which lists the uncertainty 
contribution from the top 15 individual parameters for Layer 2. Note that AAs ? o values for both VUV and 
non- VUV nitrogen lines are present in this list. Also note that while there are fewer fy than AA^o values 
in this list of the top 15 contributors, the contribution from all fij values is greater, as shown in Table 4. 
This is a result of the fij values influencing the radiative flux from the numerous weak atomic lines, which 
contribute when added together, while the radiative flux from these lines is essentially independent of AA^o- 
Furthermore, the 35 strong nitrogen lines listed in Table 1 result in roughly half of the total nitrogen fij(N) 
uncertainty contribution, while they result in nearly 80% of the total AAs 5 o(TV) contribution. The fij - OP 
(. TV ) refers to the group of all OP nitrogen lines (so it does not actually refer to an individual parameter). 
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Table 3: Total uncertainty contribution from 
parameter groups for Layer 1. 



±q r 

±Q r 

Rank Parameter 

(W/cm 2 ) 

(%) 


1 

2 

3 

hi W 
AAs.o (N) 

<J~ 

31.1 

22.3 

20.0 

8.2 

5.9 

5.3 

Table 5: 
Layer 2. 

Top 15 uncertainty contributions from individual parameters for 

4 

* bf (N) 

9.2 

2.4 



Uncertainty 

±q r 

±q r 

5 

AA s,o (O) 

4.2 

1.1 

Rank 

Parameter 

(±%) 

(W/cm 2 ) 

(%) 

6 

hi (O) 

3.1 

0.9 






7 

fij (Bands) 

2.0 

0.5 

1 

a- (TV-) 

100 

20.0 

6.2 

8 

(O) 

1.3 

0.3 

2 

fij (A 2 Birge-Hopfield) 

50 

4.8 

1.5 


Total 

93.1 

24.5 

3 

AA Si0 (A) — 174.36 nm 

50 

2.6 

0.8 





4 

d bf (A 2p3 2P / level 3) 

10 

1.8 

0.6 





5 

AA Si0 (A) — 1011.7 nm 

50 

1.5 

0.5 





6 

AAs^o (A - ) — 1052.6 nm 

75 

1.4 

0.4 

Table 4: 

Total uncertainty contribution from 

7 

fij- OP (A) 

30 

1.4 

0.4 

parameter groups tor Layer 2. 











8 

AXs,o (A) — 149.3 nm 

30 

1.3 

0.4 





9 

AAs^o (A) — 869.4 nm 

30 

1.3 

0.4 



±q r 

±« r 

10 

AAs^o (A) — 821.4 nm 

30 

1.2 

0.3 

Rank 

Parameter 

(W/cm 2 ) 

(%) 

11 

fij (A) — 919.8 nm 

50 

1.2 

0.3 





12 

fij (A^ 1- first-negative) 

10 

1.2 

0.3 

1 

hi ( N ) 

29.7 

9.2 

13 

fij (A) — 120.0 nm 

20 

1.1 

0.3 

2 

AAs.o (N) 

20.7 

6.4 

14 

fij (A) — 174.36 nm 

20 

1.1 

0.3 

3 

(7~ 

20.0 

6.2 

15 

AA S , 0 (O) — 821.4 nm 

50 

1.1 

0.3 

4 

* hf (A) 

7.9 

2.4 






5 

fij (Bands) 

7.4 

2.3 






6 

AA S)0 (O) 

4.0 

1.2 






7 

fij (^) 

3.0 

0.9 






8 

<*bf (O) 

1.4 

0.4 







Total 

93.9 

29.0 







B. Lunar Return Shock Layer 

The stagnation- line radiative flux for a 3.6 m sphere at 
10.2 km/s and 60 km is studied in this section. This con- 
figuration approximates the Orion stagnation region at 
peak heating lunar return conditions. A two-temperature 
thermochemical nonequilibrium Laura 64, 65 flowfield was 
applied, which contains radiation-flowfield coupling with 
the nominal radiative flux. The stagnation line tempera- 
ture and nominal radiative flux profiles are shown in Fig- 
ure 11, with radiative flux at wall equal to 206 W/cm 2 . 

The calculated uncertainty contributions from the 
grouped parameters are shown in Table 6 for the lu- 
nar return case. The total uncertainty for this case is 
±61.9 W/cm 2 (±30%) as compared to ±5% when treat- 
ing the input uncertainties as aleatory (known but vari- 
able according to chance). 

Except for the presence of the electron-impact exci- 
tation rates (K e i) values for this case (they did not con- 
tribute to the simplified case because it was in chemical equilibrium), the results in Table 6 are very similar 
to the dual-layer slab results presented previously in Table 4. Further similarity is apparent from Table 7, 
which presents the top 10 individual parameter uncertainty contributions. The K e i ( N (X - B)) value listed 
in this table represents the electron-impact excitation rate for the upper state of the strongly emitting 
first- negative band system. Figure 12 shows the uncertainty bars at each point through the shock layer for 
the wall-directed radiative flux. The uncertainty is seen to consist of a gradual build-up, starting at shock 
(z = 18 cm) and increasing as the wall is approached at z = 0. 



Figure 11: Stagnation-line temperature and radiative flux profiles 
for lunar return. 


9 of 15 


American Institute of Aeronautics and Astronautics 


Table 6: Total uncertainty contribution from 
parameter groups for the lunar return case. 

Table 7: Top 10 uncertainty contributions from individual parameters fo 
lunar return case. 

Rank 

Parameter 

±q r 

(W/cm 2 ) 

±9r 

(%) 

Rank 

Parameter 

Uncertainty 

±q r 

(W/cm 2 ) 

±9r 

(%) 

1 

fij (N) 

18.4 

8.9 

2 

AX s ,o ( N ) 

12.9 

6.3 

1 

a- (TV-) 

100% 

8.6 

4.2 

3 

<j- 

8.6 

4.2 

2 

a bf ( N 2p3 2P / level 3) 

10% 

2.3 

1.1 

4 

a bf (N) 

5.7 

2.8 

3 

fij {N 2 Birge-Hopfield) 

50% 

1.9 

0.9 

5 

K e i (Bands) 

4.4 

2.1 

4 

AAs^ ( N ) — 174.36 nm 

50% 

1.6 

0.8 

6 

fij (Bands) 

3.9 

1.9 

5 

K el (i V+ (X - B)) 

0(1) mag. 

1.6 

0.8 

7 

K ei (N) 

2.4 

1.2 

6 

AA S)0 {N) — 1011.7 nm 

50% 

1.1 

0.5 

8 

AX s ,o ( O ) 

2.6 

1.3 

7 

AAs^o {N) — 149.3 nm 

30% 

0.9 

0.4 

9 

fij (^) 

1.8 

0.9 

8 

AAs^o (N) — 869.4 nm 

30% 

0.8 

0.4 

10 

<*bf (O) 

0.76 

0.4 

9 

fij -OP ( N ) 

30% 

0.8 

0.4 

11 

K e l (O) 

0.44 

0.2 

10 

AA s ,o (N) — 1052.6 nm 

75% 

0.8 

0.4 


Total 

61.9 

30.0 








Figure 12: Stagnation-line radiative flux profile with uncertainty bars for the lunar return case. 


C. Fire II: 1636 and 1643 Second Trajectory Points 

The radiative heating for the Fire II flight experiment 66 has been studied previously with Hara coupled to 
viscous shock-layer (VLS) flowfield. 3 For the present study, the Laura flowfield solver is applied instead, 
as it was for the lunar-return case considered in the previous section. Two trajectory points are considered 
presently. The 1636 second case ( Ui n f = 11.31 km/s, altitude = 71.02 km) was chosen because it contains 
significant regions of thermochemical nonequilibrium while also producing significant radiative heating. The 
1643 second case ( Ui n f = 10.48 km/s, altitude = 53.04 km) was chosen because it represents the trajectory 
point of peak radiative heating. 

For the Fire 1636 case, the grouped and individual parameter uncertainty contributions are listed in 

Tables 8 and 9, respectively. The total uncertainty for this case is ±26.4%, with the nominal radiative 

flux a equal to 71.9 W/cm 2 , which again is much higher than ±4.6% if one claims to know input parameter 
distributions, means, and variability. 

For the Fire 1643 case, the grouped and individual parameter uncertainty contributions are listed in 

Tables 10 and 11, respectively. The total uncertainty for this case is ±28.9%, with the nominal radiative 

flux equal to 492.9 W/cm 2 , where uncertainty based on variability gives ±5.1%. 

a This nominal radiative flux shown here is slightly different than that presented by Johnston et al. 3 because the shock 
capturing of the Laura flowfield produces a slightly different nonequilibrium region than the discrete shock VSL approach 
applied previously. 
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Table 8: Total uncertainty contribution from 
parameter groups for the Fire 1636 case. 


Rank 

Parameter 

±q r 

(W/cm 2 ) 

±q r 

(%) 

1 

fa W 

6.7 

9.3 

2 

AA s ,o (N) 

5.0 

7.0 

3 

K e i (Bands) 

2.9 

4.0 

4 

a bf ( N ) 

2.8 

3.9 

5 

fij (Bands) 

2.4 

3.4 

6 

K cl ( N ) 

2.3 

3.2 

7 

AA s ,o (O) 

0.7 

0.9 

8 

(T~ 

0.5 

0.7 

9 

hi ( o ) 

0.4 

0.6 

10 

K el (O) 

0.4 

0.6 

11 

cr bf (O) 

0.2 

0.3 


Total 

24.3 

26.4 


Table 10: Total uncertainty contribution from 
parameter groups for the Fire 1643 case. 


Rank 

Parameter 

±q r 

(W/cm 2 ) 

±q r 

(%) 

1 

fa (A0 

44.9 

9.1 

2 

AAs.o ( N ) 

33.5 

6.8 

3 

(T~ 

18.8 

3.8 

4 

a bf (1 V) 

13.5 

2.7 

5 

fij (Bands) 

11.1 

2.2 

6 

AA^o ( O ) 

5.9 

1.2 

7 

K e i (Bands) 

5.5 

1.1 

8 

fij (O) 

3.6 

0.7 

9 

K el (N) 

3.0 

0.6 

10 

°bf (O) 

1.8 

0.4 

11 

Kei (O) 

0.7 

0.1 


Total 

142.4 

28.9 


Table 9: Top 10 uncertainty contributions from individual parameters for 
the Fire 1636 case. 


Rank 

Parameter 

Uncertainty 

±q r 

(W/cm 2 ) 

±9 r 
(%) 

1 

K el (JV+ (X - B)) 

0(1) mag. 

2.1 

2.8 

2 

a bf (N 2p3 2P / level 3) 

10% 

1.2 

1.6 

3 

a bf (N 2p3 2D / level 2) 

10% 

1.1 

1.5 

4 

fij {K 2 Birge-Hopfield) 

50% 

0.8 

1.1 

5 

fij (N 2 Worley) 

50% 

0.6 

0.9 

6 

AA Sj0 (N) — 174.36 nm 

50% 

0.6 

0.9 

7 

AAs^o (AT) — 149.3 nm 

30% 

0.5 

0.7 

8 

a” (7V-) 

100% 

0.5 

0.7 

9 

fij (N^~ first-negative) 

50% 

0.4 

0.5 

10 

K el (JV+ (A - B)) 

0(1) mag. 

0.4 

0.5 


Table 11: Top 10 uncertainty contributions from individual parameters for 
the Fire 1643 case. 



Uncertainty 

±q r 

±q r 

Rank 

Parameter 

(%) 

(W/cm 2 ) 

(%) 

1 

a- (N~) 

100 

1.8 

3.8 

2 

a bf ( N 2p3 2P / level 3) 

10 

5.7 

1.2 

3 

fij (AT 2 Birge-Hopfield) 

50 

5.3 

1.1 

4 

AA s ,o (AT) — 174.36 nm 

50 

5.0 

1.0 

5 

AA S , 0 (AT) — 149.3 nm 

30 

2.6 

0.5 

6 

fij (N 2 Worley) 

50 

2.2 

0.4 

7 

fij ( K ) — 174.36 nm 

20 

2.0 

0.4 

8 

AA^o (O) — 130.35 nm 

50 

2.0 

0.4 

9 

AAs^o (A/ - ) — 869.4 nm 

30 

2.0 

0.4 

10 

AAs^o (AT) — 821.4 nm 

30 

1.7 

0.3 


Comparing the 1636 results (Tables 8 and 9) with the 1643 results (Tables 10 and 11) provides insight 
into the differences in the radiation uncertainty between a relatively strong nonequilibrium (1636) and 
equilibrium (1643) cases. As expected, the electron impact excitation rates [K e i (Bands), K e \ (N), and K e \ 
(O)), which govern the non-Boltzmann state populations and therefore the nonequilibrium radiation, are 
seen to contribute ±7.8% for 1636 and only ±1.8% for 1643. Furthermore, the individual electron impact 
excitation rates, K e \ (N^ (X - B)) and K e \ (A - B)), which govern the upper state of the first- 

negative band system, are among the top 10 contributors for 1636, while no electron impact excitation rates 
rank in the top 10 for 1643. 

The negative ion (a~) contribution is smaller for the 1636 case because the shock layer temperatures 
are higher than the 1643 case, which decreases the negative ion number density. However, the negative ion 
contribution is smaller for the 1643 case than the lunar return case studied in the previous section. This is 
a result of the Fire shock layer being significantly thinner (4 cm) than the lunar return case (20 cm), which 
means the radiation is less optically thick and the continuum radiation contributes less relative to the atomic 
lines. 

An interesting result of the present analysis is the uncertainty of the intensity between 0 and 6 eV 
(I (0-6 eV)), or above 200 nm. This quantity was measured by the Fire II radiometer, 66 and is therefore 
of particular interest. The present analysis results in I (0-6 eV) of 4.8 ± 1.5 W/cm 2 /sr for the 1636 case, 
which compares well with the measured result of 4.9 ± 1.1 W/cm 2 /sr. For the 1643 case, the present analysis 
results in I (0-6 eV) in 51.1 ± 13.8 W/cm 2 /sr, which overlaps the error bounds of the measured result of 
63.0 ± 14.5 W/cm 2 /sr. 
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VII. Concluding Remarks 


By using a new uncertainty markup technique, direct numerical differentiation and the Cauchy Deviates 
Method were used to investigate the uncertainty of lunar return shock layer flowfield radiation due to 
epistemic uncertainty in the radiation modeling parameters. It is shown that previous uncertainty analyses 
based on aleatory uncertainty led to unjustifiably small uncertainty levels. 

The High-temperature Aerothermodynamic Radiation Algorithm (Hara) was applied in this study for 
the radiation predictions, and the following parameter uncertainties were considered: atomic line oscillator 
strengths, atomic line Stark broadening widths, atomic photoionization cross sections, negative ion pho- 
todetachment cross sections, molecular bands oscillator strengths, and electron impact excitation rates. An 
assessment of the uncertainties for each of these parameters was conducted based on available published 
data. 

A simplified shock layer problem was considered to isolate the uncertainty contributions from the strongly 
emitting and strongly absorbing regions of the shock layer. This simplified problem consisted of two constant 
property layers of equilibrium air with the thickness, pressure, and temperature of each layer chosen to 
represent the inviscid region and boundary layer of a typical Lunar return shock layer. The results of this 
simplified problem show that for conditions of chemical equilibrium, the atomic nitrogen oscillator strengths 
and Stark broadening widths in both the vacuum ultraviolet and infrared spectral regions are the dominant 
uncertainty contributors, along with the negative ion continuum. 

Following this simplified case, three stagnation line shock layer cases were studied: a typical Lunar 
return case consisting of a 3.6 m sphere at 10.2 km/s and 60 km, and the Fire II 1636 and 1643 second 
trajectory point cases. These cases considered actual variable property stagnation line flowfields obtained 
from the Laura flowfield solver. For the strongly equilibrium Lunar return and Fire 1643 cases, the resulting 
uncertainties were very similar to the simplified case. Conversely, the relatively nonequilibrium 1636 case was 
subject to a significantly larger influence from electron impact excitation rates of both atoms and molecules. 
For all cases, the total uncertainty was found to be around ±30%. 

An interesting result of the present analysis is that no individual parameter contributed more than 7% 
to the total uncertainty. Also, although the atomic nitrogen oscillator strengths contributed the most uncer- 
tainty as a group for each case, they represented only one of the top 10 contributing individual parameters. 
This is a result of the many small oscillator strength uncertainties combining to a significant value. The 
Stark broadening widths contributed as many as 5 of the top 10 individual parameters, but their group 
contribution was smaller because they have no influence on the numerous weak optically thin lines. 
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